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ABSTRACT 


The purpose of this experiment was to study the verbal 
behavior patterns of 15 P-3C and 15 non-P-3C aviators to 
determine a voice command vocabulary structure to be used 
with machine voice recognition hardware for implementation 
in the P-3C aircraft. Subjects were required to give a 
one or two-word verbal command response to a visual slide 
stimulus of a simulated P-3C pilot's display. There were 
five distinct sets of slides, each portraying a different 
visual presentation. The subjects received the five sets 
in each of three blocks giving a total of 15 responses per 
subject. The verbal responses were recorded along with 
response latencies. Response latencies decreased for both 
groups as they progressed through the experiment with P-3C 
group always having the lower latency times. Both groups 
preferred using a two-word versus one-word command to des- 
cribe changes on the visual display. Due to the two groups 
different aviation backgrounds there was no uniform prefer- 
ence for a specific syntactic structure of the command 
phrases. The implications of the findings for the design 


Of systems using vocal commands are discussed. 
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PEN TRODUCETION 


With the advent of high-speed computer processing, 
coupled with electronic miniaturization techniques, tech- 
nology has developed at an exponential rate. In order to 
keep up with ever-increasing technological advances, human 
factors research has done much work involving the efficient 
ШЕс  ОІ visual, auditory, and coordinated motor skill activi- 
ties by human beings. However, these efforts and the human's 
capabilities as an operator are approaching their limits 
rapidly as advancements in and the numbers of complex 
systems and subsystems with which the operator must inter- 
face increase. For example, during World War II the P-51 
fighter aircraft had nine subsystems and approximately 40 
switches. The F-lll has 22 subsystems and over 220 switches 
(Reising, 1973). 

In particular, aircraft crews are being presented with 
Шеке ana more information through their auditory and visual 
channels to which they must respond with coordinated motor 
processes. In conjunction with these demands the operator 
must also continue the primary task of either flying the 
aircraft within a specified envelope or keeping track of 
mecactical display. 

As the demand for time sharing is increased between 
primary and several secondary tasks the load placed on the 


operator in this eye/hands busy environment will inevitably 
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lead to an operator overload and consequently degrade the 
primary task. A possible solution to reducing the time- 
sharing requirements and biomechanical manipulations is 
through the use of voice-actuated commands to operate com- 
plex subsystems while the operator maintains visual and 
Motor concentration on the primary task. 

Before going into the details of an actual voice command 

system a basic understanding of the human speech process is 
order. The parts of the body that contribute to the 
human speech pattern are shown in Figure l. Voiced sounds 
are produced when forced air from the lungs passes between 
the openings of the vocal chords. One example of a voiced 
sound would be when a vowel such as the letter /a/ is spoken. 
When the openings between the vocal chords are small, high 
frequency sounds are generated and when the openings are 
comparatively larger lower frequency sounds are produced. 
The vibrations of the vocal chords produce the fundamental 
frequency and its harmonics of the human speech pattern. 
Unvoiced sounds can be produced when air passes over sharp 
edges such as the teeth and becomes turbulent air flow. 
An example of an unvoiced sound would be the letter /s/. 
Unvoiced sound can also be generated when the vocal cavi- 
ties are changed in shape and size as the position of the 
tongue, lips, and soft palate changes. The fundamental 
frequency is not present in unvoiced sound (Saib, 1974). 

Energy levels, called formants, are used to analyze 


the complex waveforms produced in human speech.  Formants 
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FIGURE 1. Human speech organs. 
(From Reising, 1973, p. 5) 








are frequencies which result from vocal cavity resonances. 
The first three formants can be used to describe most sounds. 
Therefore, the unique qualities of a sound can be determined 
using its formant characteristics (Flanagan 1965). The 
fundamental frequency, usually designated Fo lies between 
75 and 400 Hertz (HZ). This frequency range can convey 
information which can be used to tell whether the speaker 
was male or female; whether the utterance was a question, 
exclamation, or flat statement; and if the speaker was under 


Ееее Or not. The first formant, F ranges between 200- 


js 
1000 H2; the second formant, P ranges between 750-2700 HZ 


EN iD the third formant, F ranges from 2200 HZ and higher. 


3! 
Formant frequencies are dependent on vocal cavity size and 
therefore men, in general, generate lower formant frequen- 
cies than women and children (Saib, 1974). то and all three 
formants will be found in voiced speech but only Р, апа F. 
will be found in unvoiced speech. 
The most basic sound element produced in the human 
soeech pattern is called a phoneme. There are approximateiy 
40 phonemes which describe all the English language sounds 
(Reising, 1973). For example, the /c/ in cow and the /k/ 
in keep are both described py the phoneme /k/. One approach 
to machine voice recognition is based on phoneme recognition. 
In recent years much work has been done in the area of 
voice recognition by machine, and commercial uses are already 
in operation. Two companies which presently manufacture 


such equipment are Scope Electronics, Inc. of Reston, Virginia 


EN DresnoPd Technology, Inc. of Delran, New Jersey. 
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A typical voice recognition and command system is an 
acoustic pattern classifier that produces a digital code 
output in response to a speech input (Glenn and Hitchcock, 
1971). A simplified block diagram of a voice command 
Есеп із рісіпгей in Figure 2. The acoustic speech pattern 
is first converted into an analog signal by a microphone 
and amplifier (see Figure 2). The spectrum analyzer divides 
the speech input into frequency bands using 16 bandpass 
секао ranging from 200-5000 HZ. (Reising, 1973). The 
multiplexer and analog to digital converter sample the 
bandpass filters every 1/60 second with each sample pro- 
ducing a 4-bit value (Coler and Plummer, 1974). Therefore 
a speech utterance of one second would produce 16 x 4 x 60 = 
3840 bits. The coding compressor compensates for the time 
it takes to utter the same word from different speakers or 
two utterances from the same speaker. The coding com- 
pressor eliminates redundant spectral data while reducing 
the spectral data generated by each voice command into a 
120 bit pattern for input to the classifier (Glenn and 
EEEencock, 1971). Prior to any machine recognition, а 
шата period is required. This is accomplished by 
storing in machine memory at least five samples of the 
desired vocal command. During the actual voice recognition 
sequence, incoming voice commands are compared with the 
commands in memory and recognition is accomplished provided 
the correlation between memory and incoming commands exceeds 


a preset noise rejection threshold (Coler and Plummer, 1974). 
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Simplified block diagram of a voice command 
System 
(meme keasing, 1973, p. 8) 
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The next step is to look at some of the advantages, 
disadvantages and applications of machine voice recognition. 

Some of the advantages and problems involved in machine 
voice recognition can be studied by looking at some of the 
characteristics of speech itself. Speech is the human's 
primary and natural communication channel. The utilization 
Of speech as a primary communication channel is increased 
when the language used to convey information is similar to 
the speaker's native tongue and is easy to pronounce. If 
Boards are dirficult to pronounce or distortions of familiar 
vocabulary occur then the information transfer rate will 
decrease (Seibel, 1972). 

Data shows that speech 1s potentially the highest 
capacity communication channel for human-to-computer input. 
(See Figure 3.) Although it is possible to have higher 
data input rates uSing special keyboards which input complex 
statements with one pushbutton, they are not very flexible 
and require extensive training on the part of the operator. 

Another important feature of the speech channel is that 
it is independent of the visual channel and most of the 
voluntary motor activities. Speech communication can take 
place simultaneously with manual and visual tasks and 
thereby alleviate some of the load placed upon the eye/hand 
Шисеттасе (Turn, 1974). 

An example of this feature is the use of an automatic 
Speech recognition system being used by cartographers for 


entering bathometric readings from smooth sheets into a 
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ШАШ каны MAN=TO=COMPUTER COMMUNICATION 


Communication Rate Remarks 
Mode (Words/sec.) 


Oral reading [9] 


Random words 22g Selected from 5000 word 
ао селах 
Random words 3. es Selected from 2500 most 
familiar monosyllable 
words 
Nontechnical prose S e g 
Repeating the same 8.0 One syllable 
word 4.0 Two syllables 
Silent reading ск fae 
Spontaneous speaking 2.9 - 3.6 
Handwriting [4] NUENE- .42 
Handprinting [4] лла” 253 
Typing [10] 
Skilled Ја бе 5 Text (100 wpm - 150 wpm) 
Inexperienced 52 = .4 
Stenotype (chord 
typewriter) [11] E Пру те (у из о the 
strokes of the 
typewriter 
Operating touch- 
tone telephone [4] 1.2 - 1.5 10 buttons 
Operating thumb- 
wheel input 
device ¡matices sec. xSeguence of l0 digits [12] 
tOtary dialing 1.54 digits/sec. Sequence of 10 digits [12] 
FIGURE 3. Data Rates for Human to Computer Communications 


ВОГ кп, 1974. o. 4) 
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aecmeezing computer (Scott, 1975). The automatic speech 
recognition equipment provides the cartographer the capa- 
bility of entering depth readings through the voice channel 
without taking his hands and eyes from the X-Y coordinate 
positioning device used in this procedure. He normally 
enters the bathometric readings through a keyset and thereby 
breaks his concentration on the visual and manual orocesses 
involved in the task. The automatic speech recognition 
equipment described above was built by Threshold Technology, 
fe. and had a capability of recognizing a vocabulary of 

10 digits and five control words. Svstem tests used 20 
speakers uttering 360 words each, making a total of 7200 
utterances. The machine showed a recognition accuracy of 
99.375% (Scott, 1975), while .347% or 25 responses were 
misinterpreted by the machine. Out of those 25 responses, 
11 were misinterpretations of the spoken digit "five" for 
Mer rdigit nine. Іп radio communications this has long been 
a problem, and has been alleviated by using the word "niner" 
instead of nine. 

Speech can reveal information about the speaker such 
Besphysiological characteristics, physical condition, and 
emotional state (Williams and Stevens, 1972). Along this 
line the use of speech input allows checking the speaker's 
identity for security purposes. One svecific application 
of automatic speech recognition in this area is an experi- 


mental system called Base and Installation Security System 
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ENS Score, 1975). Instead of manually entering, via 
a keyboard, a sequence of digits to identify oneself, the 
speaker would be identified by speaking the correct digit 
sequence and having the speech pattern being correctly 
identified as the person trying to obtain entry. A possible 
drawback of a system such as this would be the event when 
the speaker was sick or under stress and could not gain 
entry. However, consider the possible situation of an 
employee under gun point. In this stressful condition, 
entry by voice recognition into an access controlled room 
would be virtually impossible and a secondary identity 
system, such as closed circuit television, would most likely 
reveal unauthorized persons in the area. 

The environment has a great effect on speech generation 
and speech propagation. Two of the forces that affect 
speech generation are vibrations and accelerations.  How- 


ever, the operation of manual input devices are also affected 


by these forces. Weightlessness has no effect on speech 
Eueduction (Turn, 1974), nor does it affect human motor 
movement. However, humans under the conditions of weight- 


lessness are usually strapped in, thus restricting movement 
Есу спе body and limbs. 

Although speech generation is affected by vibrations and 
rapid accelerations these effects are not very substantial 
(Turn, 1974). It has been shown in experiments (Glenn, 


Gorden, and Moschetti, 1971; Wherry, 1973) that accuracy of 
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machine speech recognition decreased 5$ when vertical 
sinusoidal vibration was increased from .05 to .3 g. When 
the subject received a sustained acceleration of 4 g, 
recognition accuracy decreased by 10%. A similar experiment 
Was carried out on the effect of vibration on tactile input 
devices involving pushbuttons, rotary dials, and thumb- 
wheels which showed a 10$ degradation of input rate at .8 g 
vibration level (Dean, Farrell, and Hitt, 1969). 

Speech production and propagation are also affected by 
the composition of the atmosphere and ambient pressure (Turn, 
1974). Speech propagation is also affected by ambient noise. 
However, hardware such as noise cancelling microphones and 
software changes to automatic speech recognition have 
alleviated many of these problems. A machine recognition 
accuracy of 97.15% was achieved in a laboratory environment 
with subjects breathing either oxygen or compressed air 
through an MBU-5 oxygen mask and using a standard noise 
EEncelling microphone (Martin and Grunza, 1974). Ambient 
pressure changes such as high altitutde pose no significant 
Problems, elther, since it is possible to simulate high 
altitude conditions using microphone equalization techniques. 
Therefore, the machine can be trained at sea level for high 
altitude conditions without the use of an altitude chamber. 

Martin and Grunza also state that, "Results indicate 
that existing aircraft microphone systems are adequate for 


pouce control applications in a cockpit environment." 
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Since human speech is being considered as a primary 
communication channel, then some type of verbal learning 
will be needed on the part of the operator in order to 
communicate effectively with the voice recognition equipment. 
Because a visual, auditory, or vestibular stimulus will be 
responded to with a specific voice command, this interface 
could be considered as paired-associate learning. It has 
been shown (Adams, 1975) that if the meaningfulness of both 
the stimulus and response terms during paired-associate 
learning is high then the percentage of correct responses 
LN be higher than for any other combination of stimulus 
and response pairs. Along these same lines it has been 
demonstrated (Adams, McIntyre, and Thorsheim, 1969) that 
using natural language mediators as compared to rote learning 
methods a higher percentage of correct responses can be 
achieved. 

Not only must the individual words in a verbal command 
be taken into account but also how these individual verbal 
commands or words fit together to produce a completed tasx 
statement which is not only recognizable to the machine 
but which makes sense to the operator both syntacticallv 
and semantically. By applying principles of grammar or 
syntactic theory, strings of words can be structurally 
decomposed to reveal whether a word string is valid or 
invalid in accord with the given grammar. This is usually 


done by decomposing the word string into a tree structure 
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called a parse (Klinger, 1973). By examining the nodes of 
a parsing tree diagram of a particular command sentence, 
the verbal behavior of the human operator could be estab- 
lished and incorporated into the hardware to facilitate the 
human-machine interface. As an example of this, languages 
are arranged by taxemes, such as order. In the English 
language the nominative expression usually precedes the 
finite verb expression, however, in German the opposite is 
true. Therefore, the equipment should be programmed to 
accommodate the human operator in the natural form with 
which the human is most comfortable. 

This will lead to a better human-machine interface 
that will reduce training requirements, enhance the relia- 
bility of the human in the system, and ensure that the 
proper performance (word commands) occurs under conditions 
of stress or information and response loads. 

In summary, it should be pointed out that although there 
are still some problem areas associated with machine voice 
recognition, the advantages for voice recognition systems 
to aid the human operator certainly surpass some of the 


restrictions imposed on the human operator. 
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ES TA REMENDTESE THE PROBLEM 


The specific area that will be under investigation is 
the incorporation of a machine voice command system into 
a P-3C aircraft based at the Naval Air Station, Moffett 
Field. The National Aeronautics and Space Administration's 
Ames Research Center, located at Sunnyvale, California, owns 
and operates voice recognition equipment manufactured by 
ope Electronics, Inc. The specific application will 
utilize voice recognition equipment to aid the pilot in 
the P-3C aircraft by using voice commands to enter and 
request data on the pilot's display (Figure 4) instead of 
using the present keyset entry mode (Figure 5). 

In order to incorporate a voice command system to replace 
the keyset panel a command vocabulary is needed to replace 
the functions performed by the keyset panel. Two specific 
problems immediately arise. First, what are the best words 
to use, as far as the human operator is concerned, and how 
will this command vocabulary be developed? The second 
problem that arises is the compatability of the newly 
developed vocabulary with the constraints of the voice 
recognition machine. This thesis will address itself mainlv 
to the problems of the human operator, although some of 
the hardware constraints will have to be taken into 
consideration in order to develop a realistic command 


vocabulary. 
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FIGURE 5.  P-3C Pilot Keyset Panel | 
(From P-3C NATOPS Flight Manual, NAVAIR 01-75PAC-1, 2025 











In the present state-of-the-art, machine recognition 
is limited to an isolated-word approach. Therefore, the 
pilot will be limited as to the number of words that can be 
used to utter a command. This is not a serious problem 
since aviators are thoroughly trained in communications 
Шшеүгетітсірііісу (Turn, Hoffman, and Lippiatt, 1974) and 
usually communicate in shortened phrases to reduce communi- 
cation errors and to keep radio channels clear. 

The approach that was used to determine an appropriate 
vocabulary was strictly empirical. An experiment was 
conducted to obtain the natural verbal behavior of experi- 
enced pilots under appropriate, simulated conditions. This 
was accomplished through the use of a slide presentation 
which simulated a P-3C pilot's environment. The slide 
Peesentation displayed a stimulus situation (Gagne, 1970) 
which posed a problem of creative description to the subject 
in which a response of one or two words was required. 

The subjects were from two distinct groups of aviators. 
One group was familiar with the P-3C aircraft and the other 
group was not. The reason for this was to gather data 
which would be used in designing future systems based on 
the verbal behavior patterns of the two groups. The P-3C 
group may provide responses based on previously learned 
principles and recognition of the stimulus problems. 
Accordingly, their verbal behavior might be biased. 


Therefore, in the implementation of the initial voice 
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command systems the verbal responses of the existing 

P-3C community should most likely be incorporated into the 
Voice command system to reduce training and improve relia- 
bility of the system. On the other hand, the verbal 
responses of the non-P-3C group must be considered for the 
long-range implementation of voice command systems, since 
their verbal responses should be naive. As new personnel 
enter the P-3C environment than modifications to the system 
may become necessary in order to phase out biased vocabulary 
in favor of natural human responses. Іп а more general 
sense, the responses of the P-3C subjects could be classi- 
fied as those that would be expected when an existing system 
is converted to a voice command system, and the responses 

of the non-P-3C subjects would be similar to those that 


would occur in the design of a completely new system. 
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EPIS nO 


ШІ SUBJECTS 

The subjects were 30 volunteer students at the Naval 
Postgraduate School, Monterey, California. All subjects 
were male officers. Subjects were required to have had some 
type of military aviation experience and 15 of the subjects 
were required to have had P-3C flight experience. The P-3C 
group was designated AVTYPE 1 and the non P-3C group was 
designated AVTYPE 2. Both groups averaged over 1000 flight 
hours in their respective aircrafts and the ranks of the 
subjects were either Lieutenants or Lieutenant Commanders. 
The volunteers received no payment or gratuities of any 


kind for participating in the experiment. 


B. APPARATUS 

The apparatus consisted of an acoustic-absorbing 
testing chamber with a 61 by 76 cm. opague glass section 
in one wall on which the visual stimulus could be rear 
projected to the subject from outside the testing chamber. 
A Kodak Ektagraphic slide projector, model AF-2, was used 
project the visual stimulus to the subject. A Lafayette 
Instrument's interval timer was used to program slide 
presentations and blank periods. An intercom system was 
installed to provide two-way communications between the 


Subject and the experimenter, who remained outside the 
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ehamber during the conduct of experimental trials. А 
Robert's cassette tape recorder was used to record and 
present a taped briefing of the details of the experiment 
to the subjects, and a manually operated stop-watch was 
used to determine the verbal reaction time to the visual 
stimulus. 

Stimuli consisted of five sets of slides which were 
made using a Kodak Ektamatic Visualmaker and had black 
backgrounds with white lettering to simulate the visual 
presentation on the P-3C aircraft's pilot display. 

Three of the five sets of slides were made up of two 
slides while one set had three slides and the other four. 
Each set of slides represented one task for the subjects. 
The first slide of each set was labeled at the top with 
the word "BEFORE", and the last slide of each set was 
labeled at the top with the word "AFTER". (See Figures 


ET. ) 


ШИ EXPERIMENTAL DESIGN 

Each subject was shown three blocks of slides with each 
block consisting of the five sets. The order of presenta- 
tion was randomized within each block with the restriction 
that the last set of slides in each block could not be the 
first set of slides in the following block (see Figure ll). 
The independent variables were the two aviation groups, the 
three blocks of slides shown to each subject, and the five 
tasks involved during the slide presentations. The dependent 


variables were the response times to each of the five 


29 











BE FORE 
AFTER 





FIGUR | 
E 6. Slide Set "Position" 


30 








BEFORE 


AFTER 





FIGUPE 7. о иае сет, Track” 








BEFORE AFTER 





FIGURE 8. STT се: "Correct" 
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FIGURE 9. Slide Set "Center" 
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FIGURE 10. Slide Set "Scale" 
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Figure 11 


Order of Presentation of Slide Sets 
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distinct sets of slides and the verbal response content. 
A total of 15 responses per subject was required during 


the experiment for an overall total of 450 data points. 


БОО PROCEDURE 

Each subject was greeted and escorted into the sound- 
absorbing chamber where he was asked to fill out a ques- 
tionnaire pertaining to the subject's aviation experience 
(Appendix A). The subject was then seated in front of the 
viewing screen, which was approximately 61 cm. away. The 
experimenter remained with the subject. The subject was 
then shown a sample slide presentation in conjunction with 
a taped briefing describing the experiment and the subject's 
task. In essence, the subject was asked only to give a 
one or two-word verbal command which the subject felt 
would describe what had changed during each set of slides. 
A complete typed version of the taped briefing is located 
under Appendix B. When the taped presentation was con- 
cluded the subject was provided time to ask any questions. 

After the question period the experimenter left the 
testing chamber and performed an intercom check with the 
subject. The subject was then presented with one blank 
slide prior to the start of the experiment. Then the 
subject was shown the 15 sets of slides. Each slide was 
shown for 10 seconds, based on the visual recognition 
aeua Of Potter and Levy (1969). The first slide of each 


set was labeled at the top with the word "BEFORE" to represent 
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what the pilot would initially see. The subject then saw 
one or more slides to depict what would happen on the dis- 
play when the pilot pressed a desired key function on the 
pilot's keyset panel. The last slide of each set was 
labeled at the top with the word "AFTER" to signify the end 
of that set and to cue the subject to give an appropriate 
one or two-word command which described what had changed on 
the slides. The changing part of the slides was indicated 
with a small white arrow. The subject then saw one blank 
slide before the next set of slides started.  Therefore,the 
subject had 20 seconds to give a verbal response. The 
experimenter recorded the verbal response and reaction time 
on the Subject Data Sheet (Appendix A). After the last 
response was recorded, the subject was notified over the 
intercom system that the experiment was over. The subject 
was then asked to write down any comments about the experi- 
ment. Upon dismissal, subjects were requested not to discuss 
the experiment with potential subjects. The entire procedure 


lasted approximately 25 minutes. 
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TA NEMUS SUP S 


Several analyses were done relating to word frequency, 
response times and syntactic structure of two-word responses 
using the Statistical Package for the Social Sciences 
(SPSS). These analyses were computed using all subjects, 
subjects by AVTYPES and subjects by AVTYPES and BLOCKS. 

A complete codebook (Appendix C) shows fully how each sub- 
ject and the verbal responses, along with their respective 
reaction times, were classified for entry onto computer 
Cards for statistical analysis. 

Tables 1-5 show the absolute and relative frequencies 
of the verbal responses to each of the five sets of slides 
tested. Although it appears that there are many different 
responses in each category, several of the responses include 
the word or words which are presently written on the P-3C 
pilot's keyset panel. For example, under the variable 
labeled "Position" (Table 1) the first eight responses 
included some form or variation of the word position. 
Therefore, they comprised 93.3% of the total responses for 
both aviation groups under that variable. Using a similar 
analysis the following results were obtained: 87.85 of 
the responses incorporated variations of the word "track" 
in that category, 48.9% of the responses under the varlable 
E cct" used a Form of the word correct, 93.3% of the 


responses under the variable "center" utilized a variation 
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TABLE 1 


ЕНБАН БЕЗРОМСЕЗ АМО ТНЕТІБВ EREQUENCY TO SLIDE SET 1 
(POSITION) FOR ALL SUBJECTS AND BY AVIATION TYPES 


Responses All Subjects AVIYPE 1 АУТҮРЕ 2 

For Slide Relative Relative Relative 
Set Frequency Frequency Frequency 
Position Frequency (Pct.) Frequency (Pct.) Frequency (Pct.) 
Position ас 30.1 175 55 18 40.0 
Display 

Position 7 7.8 5 TIT 2 4.4 
Aircraft 

Position 28 son 18 40.0 10 22,2 
Posit 6 O. 7 3 Sy 3 6 7 
Show 

Position 3 EM 3 6.7 
Present 

Position 2 252 2 aA 
Aircraft 

Posit 4 4.4 4 8.9 

Mark 

Position 1 БО 1 252 
Lat Long 3 229 3 бы 
Bearing 1 ПОА: Ф 252 
Fix 1 I | Do 
No Response 1 Е 1 22 
Total 90 10070 45 100.0 45 100.0 
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TABLE 2 


TERE RESPONSES AND THEIR FREQUENCY TO SLIDE SET 2 
(TRACK) FOR ALL SUBJECTS AND BY AVIATION TYPES 


Responses All Subjects AVTYPE 1 AVTYPE 2 
For Slide Relative Relative Relative 
Set Track Frequency Freq. (Pct.) Frequency Freq. (Pct.) Freg. Freq. (РСЕ.) 
Aircraft 
Track 46 Sui 34 15.6 > 2657 
Display 
Track ШЕ! E 8 17.8 B Get 
Track |. 12.2 2 4.4 9 240158 
Show Track 3 303 S o 
Ground Track 2 22 2 4.4 
Macs Aircraft 2 2,2 l DZ l 2:2 
Trackline 2 Z2 2 4.4 
Display Trackline 1 121 l 222 
Track History il IE Т 22 
Mark Turn Ji bu de 22 
pur Turn I TeL l 252 
pnt Turn | E ib 2 
Bearing 2 2:27 à) 2 4.4 
Status 3 d 3 ox 
Drop Points 1 ee]: 1 27 
Mid Drop Point Í ШЕ: | 2.2 
Drop Midpoint iL isl 1 2.2 
No Response 0 040 0 0.0 
Total 90 100.0 45 100 0 45 100.0 
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TABLE 3 


ШИБЕІАІН 5 Ро о ДИО THEIR FREQUENCY TO SLIDE SET 3 
(CORRECT) FOR ALL SUBJECTS AND BY AVIATION TYPES 


Responses All Subjects AVIYPE 1 AVIYPE 2 

For Slide Relative Relative Relative 
Set Frequency Frequency Frequency 
Correct Frequency (Рета) Frequency (Pct.) Frequency (Pet...) 
Aircraft 

Correct 27 30.0 24 55.5 3 077 
Correct 

растае 7 7.8 2 4.4 5 Ше 
Correct 

Track 3 D F 2 4.4 al: D 
Correct 

Position I MER 1 2.2 
Correct 1. | Ib 222 
Correction ПЕ ІІ 1 2e 
Correct 

Position 2 2:52 2 A 
Correct 

Trackline I DE 1 2:2 
Slew 

Correction 1 НЕ! Ш 252 
Aircraft Slew 3 DN 3 NE 

Slew Left 2 Zee 2 4.4 
Update 

Aircraft 6 Oy l 2552 5 ДЕДІ 
Update 3 p 3 6:7 
Update 

Position 2 252 2 4.4 
Aircraft Plot 3 Sis 3 6.7 
Parseratt Left 2 22 2 AA 
Displace 

Aircraft 3 SIS 3 6.7 
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TABLE 3 (Continued) 


Responses All Subjects AVTYPE 1 AVTYPE 2 

For Slide Relative Relative Relative 

set Frequency Frequency Frequency 

Correct Frequency (PEE) Frequency MESE») Frequency (POE) 

Reposition 

Aircraft 3 Ss 3 Sc 

Relocate 

Aircraft I 1.1 1 2) 

Relocate p ШТ E 22 

Change 3 323 3 G. 7 

Mark On. Top 3 з 3 Gas 

Mark On Top 

Seven JE call 18 2:2 

Center T E 1 212 

Reset 2 252 2 4.4 

Slew Aircraft 5 56 2 4.4 3 би 

No Response 2 2:2 р 222 1 22/2 
Total 90 100.0 45 10070 45 100.0 
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TABLE 4 


VERBAL RESPONSES AND THEIR FREQUENCY TO SLIDE SET 4 
(CENTER) FOR ALL SUBJECTS AND BY AVIATION TYPES 


Responses All Subjects AVTYPE 1 AVTYPE 2 

For Slide Relative Relative Relative 

Set Center ECO е БЕЗ е гео. Ereg. (Pct.) Fred. Freq, (Pct.) 

Recenter 

Aircraft 17 18.9 14 p 3 6557 

Center 

Aircraft 26 22-9 14 BL 102 2527 

Aircraft 

Center 18 200 10 222 8 172.3 

Aircraft 

Recenter 5 5.6 2 4.4 3 6: 7 

Center ls 14.4 4 8.9 9 20.0 

Center 

Display 2 2202 2 4.4 

Center Bug 2 212 D 4.4 

Center 1 — 

Pipper 1 T 

Shift 

Display 1 pd 1 272 

Aircraft 

Plot 2 222 2 4.4 

Reposition 1 т ] 222 

No Response 2 252 2 4.4 
Total 90 100.0 45 100.0 45 100.0 
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TABLE 5 


DEPBBASCORESPONSESCAND THEIR FREQUENCY TO SLIDE SET 5 
(SCALE) FOR ALL SUBJECTS AND BY AVIATION TYPES 


Responses All Subjects AVTYPE 1 AVTYPE 2 
For Slide Relative Relative Relative 
Set Scale Freq. Freq. (Pct.) Freq. Freq. (Pct.) Freq. Freq. (Pct.) 
Increase 
Scale 24 26.7 14 Вт 10 22702 
Up Scale 30 2252 27 60.0 3 6.7 
Scale Up 3 БЕЗ 1 222 2 4.4 
Scale 3 953 3 STU 
Show Scale НЕ en Ц 282 
Enlarge Scale 2 222 2 4.4 
Scale Increase 3 B. 3 3 Sl 
Scale Change 3 383 9 6.7 
Change Scale 3 In 1 2.2 2 4.4 
Display Scale 1 J. T De 
Scale 64 7 Jis 2 4.4 5 ER | 
Range Up ll TL l 2 
Buoy Range 2 212 2 4.4 
Sonobuoy Range l P l 2:2 
Range Increase 1 ШЕ: 1 292 
Range Times 4 2 252 2 4.4 
Enlarge ПЕ gr 1 22 
Up Two 2 2 2 4.4 
No Response 0 sis 

Total 90 lp 45 000 45 100.0 
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of the word center, and 88.9$ of the responses under the 
variable "scale" used a form of that word. 

Tables 6-8 show the mean and standard deviation of the 
response times to each set of slides for the overall 
experiment in conjunction with BLOCKS 1-3. Through compar- 
ison of statistics in Tables 1-5 it can be demonstrated 
that the responses of AVTYPE l comprised a higher percentage 
of the variable words under consideration than those for 
AVTYPE 2. Likewise, it can be shown in Tables 6-8 that the 
response latencies for AVTYPE l were in all cases lower 
than those for AVTYPE 2. 

A three way analysis of variance was performed due to 
the structure of the experimental design (Edwards, 1968). 
The results are shown in Table 9. The only significant 
effects (P < .001) are those of the main effects: AVTYPES, 
ENSCKS, and TASKS. 

Duncan's Multiple Range Test (Edwards, 1968) was used 
(Tables 10 and 11) to investigate the differences existing 
among the means of the BLOCKS and the differences among the 
means of the TASKS. The underscored means do not differ 
significantly at a probability less than .001. A Range 
test was not performed on the differences between the means 
of the AVTYPES since there are only two means and the 
analysis of variance has already shown that the differences 
are significant (P < .001). 

The difference between usage of one and two-word commands 


was investigated with the results shown in Table 12. The 
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reason for this analysis was to determine if there was a 
preference by the subjects in using a one or two-word 
command. To test the preference for either a one or two- 
word command the Binomial Test (Siegel, 1956) was used 
since all the observations from the sample population fell 
into either one of two discrete classifications. The 

null hypothesis tested was that no difference existed 
between the probability of either using a one or two-word 
command (i.e., но: ру = P> = 5). Since the sample sizes 
were larger than 25, normal approximations of the binomial 
test were used. The null hvpothesis was rejected for both 
aviation types at the .001 level of significance and the 
conclusion was that the preference for a one or two-word 
command was not equally likely. By observing the data in 
Table 12 a preference is indicated in favor of the two- 
word commands. The difference between the mean response 
times of one and two-word commands was also analyzed since 
verbal reaction times may be critical in the pilot-voice 
machine interface. To avoid the restrictions of the t-test 
for testing the differences between two means, the Normal 
test (Freund, 1971) was used since the sample size was 
large enough for the central limit theorem to be invoked. 
The hypothesis being tested was that the mean response time 
for one-word commands would equal the mean response time 
for two-word commands (i.e., Н: U] = u, = due. тежи 


hypothesis could not be rejected at the .001 level of 


significance for both aviation types and it is therefore 
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concluded that the mean response times for one and two- 
word commands are the same. 

Since the subjects had an overwhelming preference for 
two-word commands an analysis of the syntax structure of 
the two-word commands was performed. This was done 
utilizing the same logic as the one-word versus two-word 
command analysis, and thus promotes compatability between 
the human operator and the machine insofar as syntax 
structure is concerned. 

The two-word commands were divided into two groups. 

The first group was called Command Phrases since the first 
Word was a command verb and the second word was the noun 

on which the command verb was acting (Appendix D). The 
second group was called Descriptive Phrases because the 
first word modified the second word and merely described 
changes on the pilot's visual display (Appendix E). The 
frequency and response times for these two groups are shown 
moe Table 13. 

A Binomial test (Siegel, 1956) was used to test the 
hypothesis that there was no preference between uSing either 
a command phrase or descriptive phrase (i.e., Но: рү = р, zm 
Normal approximations of the Binomial test were used since 
the sample sizes were larger than 25 for both aviation types. 
The null hypothesis was rejected for AVTYPE 1 at the .001 
level of significance but was not rejected for AVTYPE 2 at 
the same level of significance. It is therefore concluded 
that there is an АУТҮРЕ 1 preference in syntactic structure 


Sue not Tor AVTYPE 2. 
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oe Das LON 


Due to the familiarity of АУТҮРЕ 1 with the P-3C 
aircraft it was not unexpected that their verbal responses 
comprised a higher percentage of the variable words (titles 
of the slide sets) and responded with lower latency times 
than those for AVTYPE 2. These results are in keeping with 
Gagné (1970) who stated that recognition is an easier task 
than recall or other associative processes and therefore 
yields higher remembering scores. 

In considering the preference of two-word commands 
over one-word commands it was not unexpected that AVTYPE 1 
had a strong preference for two-word commands since all the 
keyset functions on the P-3C pilot's keyset panel are two 
or more words.  AVTYPE 2's preference for two-word commands 
can only be attributed to natural verbal behavior patterns. 
Since both groups preferred two-word commands and the response 
latencies were equal for one and two-word commands then it 
Seems reasonable to conclude that two-word commands have a 
definite advantage over one-word commands. The voice recog- 
nition machine also has a high recognition accuracy when 
long words or multiple words are used. 

in the last part of the analysis dealing with syntactic 
structure in human verbal behavior some interesting differ- 
ences arose. For AVTYPE 1 the null hypothesis, that there 


existed no preference between command and descriptive 


2 





phrases, was rejected. However, for AVTYPE 2 the same 

null hypothesis was not rejected. The results for AVTYPE 

І меге not unexpected since three out of the five (603) 
P-3C keyset functions under investigation were descriptive 
phrases and the other two were command phrases. The data 
verify this result since 62% of the two-word verbal phrases 
elicited by AVTYPE 1 were descriptive phrases. It is 
therefore concluded that AVTYPE 1 was biased in their 
responses and AVTYPE 2 was naive as originally hypothesized 


in the statement of the problem. 
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VI. RECOMMENDATIONS 


Based upon the results and conclusions presented in 
this thesis it is felt that the following recommendations 
should be incorporated into the machine voice recognition 
system in order to make the interface between human and 
machine more viable. Because the predominance of verbal 
responses clustered around the nomenclature on the P-3C 
keyset panel then the first approximation to the needed 
voice command vocabulary should be made up of the present 
keyset phrases. Since two-word commands were preferred by 
both aviation types then this preference should be incor- 
porated in present voice systems and future design consider- 
ations. Since AVTYPE 2 showed no preference as far as 
verbal syntactic structure was concerned either command 
phrases or descriptive phrases could be incorporated in 
the voice machine vocabulary. 

As future personnel enter the aviation community their 
verbal behavior patterns will have to be tested in order to 
modify existing voice command systems to produce the optimum 
interface between human and machine. As future hardware 
Systems are produced and developed some of the present 
machine restrictions will inevitably be reduced making the 
human-machine interface as natural as the human-human 


interface. 
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t) 
2) 
3) 


4) 


5) 


6) 


APPENDIX A 


SUBJECT QUESTIONNAIRE 


Name 
Rank 
Service 
P3-C Operational e 
(Check) Yes 
If yes: (a) 
(Б) 


Latest Operational 


(a) 
(b) 


xperience? 

МО 
Position on crew 
motal lichte. noeurs Р2-С 
aircraft flown and position, 
Almeraft type 


Position on crew 


Comments (fill in at completion of experiment) 
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If noe PJSC 





Name of Subject 


SUBJECT DATA SHEET 


Response number Verbal response Tımamg: (in see) 
T. 


D 


n. 
ET. 
Ба. 
ES. 
14. 


B3. 
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APPENDIX B 


FREEBEINSTRUCTTONS- FORZTEST SUBJECTS 


Hello! Today you will be participating in an experi- 
ment to determine a partial vocabulary needed for a computer 
voice command system being developed at Nasa Ames Research 
Center. This experiment is being run to determine the 
most natural words or phrases that a pilot would use to 
command information on a visual display. These words and 
phrases would then be utilized in a computer voice command 
system to replace the manual keyset functions which now 
Baste to display pertinent information on the pilot's 
display. Please listen carefully since most of the infor- 
mation presented on this taped briefing should help you 
identify what will be happening during the experiment. 

You will be presented with 15 sets of slides. The 
first slide of each set will be labeled at the top with 
the word "BEFORE" and will represent what the pilot initially 
Sees. You will then see one or more slides to portray what 
the pilot would see after pressing the desired key. The 
last slide of each set will be labeled at the top with the 
word "AFTER" to signify the end of that set and to key you 
to give your verbal response. 

The slides depict a pilot's visual perspective of what 


the aircraft is actually doing in a horizontal plane. The 
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display can also show other pertinent information which 
will be fully explained. (SLIDE ONE) 

On the right side of the pilot's display is a label 
Seated "MILES FROM MIDDLE TO EDGE OF DISPLAY". The 
mileage displayed here will either be 2, 4, 8, 16, 32, 64, 
Ex 128. 

On the top of the display is an area for computer 
generated alerts which we will not be dealing with. On 
the left side of the display the pilot can be presented with 
the aircraft's altitude and at the bottom labeled "CUEING 
AREA" the pilot can be presented with information such as 
where the aircraft is presently located in degrees of lati- 
tude and longitude. (SLIDE TWO) This slide represents 
what the pilot actually sees, except for the arrow. The 
pilot can move the aircraft symbol or move a sonobuoy, for 
Our purposes labeled #7, 1f either is determined to be in 
the wrong location electronically. The pilot can also show 
where the aircraft has been by displaying small + characters 
behind the aircraft symbol. 

As previously mentioned, the first slide of each set 
will be labeled "BEFORE". You will then see one or more 
slides to represent what the pilot would see after pressing 
the appropriate key. The last slide of each set will be 
labeled "AFTER" to signify the end of that set and to key 
you to give your one or two-word command which you would 
use to represent what has changed on the display. There 


will be one blank slide between each set of slides. You will 
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see each slide for 10 seconds. Your verbal response will 
be timed when the slide labeled "AFTER" first appears in 
front of you. No response should be made until you see 
the slide labeled "AFTER". You will see the slide labeled 
"AFTER" for 10 seconds and then a blank slide for 10 
seconds giving you a maximum time of 20 seconds to give 
your one or two-word command. 

The slides will always show the aircraft symbol and the 
sonobuoy labeled $7. The reason for the sonobuoy i7 is 
to give you a perspective with the aircraft symbol when 
movement is involved. For example, if the mileage from 
the center to the edge of the display is changed then the 
aircraft symbol and the sonobuoy $7 may appear to be farther 
apart or closer together. 

There will also be a small arrow on all the slides 
weng to the changing part of the display which your 
response should be centered around. 

Before starting the experiment there will be one exam- 
ple. (SLIDE THREE) In front of you is a slide labeled 
"BEFORE" with the aircraft symbol and the sonobuoy #7. You 
will see every slide for 10 seconds. (SLIDE FOUR) Now the 
Slide labeled "AFTER" is shown with the arrow pointing to 
the 7; 5000. Your verbal command might be altitude or 
werat altitude. 

Remember, your verbal response will be timed when the 
slide labeled "AFTER" first appears in front of you and no 


response should be made until you see the slide labeled 
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"AFTER". If you have no idea at all what is happening 
during a set of slides do not say anything. 

Some of the sets of slides will be repeated. If you 
recognize a set of slides that you have seen before give 
your best response whether it be the same or different 
than your previous response to that set of slides. 

When you give your response to a set of slides please 
say only your one or two-word command. 

You do not need to press any buttons on the intercom 
system. When the experiment is done I will notify you on 
the intercom system. 

Please do not discuss the experiment with anyone who 
may be a future subject since you may bias future subjects 
with the vocabulary you felt was appropriate during the 
experiment. 


Are there any questions? 
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APPENDIX 


CODESOOR 


VARIABLE NAME 


ID 


AVTYPE 


BEOCK 


POSITION 


TRACK 


64 


e 


VARIABLE DESCRIPTION + CODES 
Subject ID c (1-30) 


Flying Experience 
l.  P3C Experience 
2. Non P3C Experience 


за осе + 
IX тла | 15 
2 И та! = 6-10 
ои на es. 11-15 


Response to first slide of 
Blocks 1,2,3 respectively 


ДЕ? POSITION 

2 DISPLAY POSITION 
3. A/C POSITION 

4. POSIT 

Sr SHOW POSITION 

oe PRESENT POSITION 
p^ A/C POSIT 

Se MARK POSITION 

9. LAT LONG 
10% BEARING 

ШЕЕ 

99. NO RESPONSE 

nd 


Response to 2 slide of 
Blocks 1,2,3, respectively 


DISPLAY TRACKLINE 
PRACT EHISTORY 
10. MARK TURN 
ILL OTTO RN 

Pen ican TURN 

ШОН SEARING 

TI UO STATUS 

jO DROP. POINTS 
Loe tea OROr POINT 
sO. MIDPOINT 
DIO RESPONSE 


И A во а 

2 РОНА TRACK 
БИТ ОК 

4. SHOW TRACK 

5. GROUND TRACK 
СЛ КЕЛСЕК АУС 

Ti MIRACKETNE 

Sie 

Вс 





COLS VARIABLE NAME ETABS DESCRIPTION t CODES 


10 CORRECT Response to 37° slide of 
Blocks 1,2,3 respectively 
ieee oe CORRECT 
2. CORRECT A/C 
оног. TRACK 
Ae CORRECT POSITION 
5; CORRECT 
с СПОЈЕ О Феј 
DEOR RSEemEPpOoSrTrTnION 
Ses EORRETTSTRACKLINE 
9. Sune CORRECTION 
10. A/C SLEW 
ДЕЕ SLEW A/C 
12, SLEW LCEFT 
13. UPDATE A/C 
E. UPDATE 
TS UPDATE POSITION 
l6 A/C PLOT 
Dy Aye eer T 
18. DISPLACE A/C 
129% REPOSITION A/C 
20: RELOCATE A/C 
Zu RELOCATE 
22. CHANGE 
9 MARK ON TOP 
24. MARK ON TOP SEVEN 
295 CENTER 
263 RESET 
ОО NO RESPONSE 
E12 CENTER Responses to 4°" slide of 
Blocks 1,2,3 respectively 
1:2: RECENTER A/C 
ОЕ СЕМЕ КЕДИ 
3% A/C CENTER 
4. A/C RECENTER 
9. CENTER 
re CENTER DISPLAY 
s SENDER BUG 
8. CENTER PEPPER 
Ir Soe DISPLAY 
102 E POT 
L D REPOSITION 
p NO RESPONSE 
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COLS 


13-14 


DET 


w3 20 


ЕЕ 23 


24-26 


1-29 


40 


УАКТАВГЕ МАМЕ 


SCALE 


РОБЕ 


RTTRACK 


RECORECT 


RTCENTER 


RTSCALE 


TASKS 


VARIABLE DESCRIPTION + CODES 


Response to Б. 


h slide of 


Blocks 1,2,3 respectively 


1. INCREASE SCALE 
CLAS SALE 
AS CAME ПР 
a SCALE 
SAO SCALE 
6. ENLARGE SCALE 
7. SCALE INCREASE 
8. SCALE CHANGE 
SE CHANGE (SCALE 
JO DISPLAY SCALE 
е” SCALE 64 
12. RANGE UP 
T3- BUOY RANGE 
l4.  SONOBUOY RANGE 
15 RANGE INCREASE 
l6. RANGE TIME 4 
17. ENLARGE 
18. ОР TWO 
DIE ENOZRESPONSE 


Reaction times 
1 671] in secs 
cac 3.1) 


Reaction times 
2,7,12 in secs 
See ВО. 


Reaction times 
аз in secs 
sec (F 3.1) 


Reaction times 
4,9,14 in secs 
Sec (F 351) 


ker 
and 


Fer 
апа 


fo 
ana 


For 
and 


responses 
nearest 1/5 


responses 
nearest 1/5 


responses 
nearest 1/5 


responses 
nearest 1/5 


Reaction times for responses 
5,10,15 in secs and nearest 1/5 


sec (F 3.1) 


NAMES OF TASKS 


[POST TON 
2 TRACK 

Se CORRECT 
JOE CENTER 
SCALE 
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APPENDIX D 
COMMAND PHRASES 


Display Position 
Show Position 
Present Position 
Mark Position 


Display Track 
Show Track 

Track Aircraft 
Display Trackline 
Mark Turn 

F bot Turn 

Вар еол ПЕ 


Correct Aircraft 
Correct Track 
Correct Position 
correct Traekline 
Slew Correction 
Slew Aircraft 
Slew Left 

Update Aircraft 
Update Position 
Displace Aircraft 
Reposition Aircraft 
Relocate Aircraft 
Mark оп Тор 

Mark on Top 7 


Recenter Aircraft 
Center Aircraft 
Center Display 
Center Bug 

Center Pipper 
Shift Display 


Increase Scale 
Up Scale 

Show Scale 
Enlarge Scale 
Change Scale 
Display Scale 


67 





APPENDIX E 


Ines IDE PHRASES 


Ajreraft Position 
Aircraft РОЗЈЕ 
Lat Long 


Aireraterreack 
Ground Track 
Track Hrstrory 
paru ЕДЕ 
Drop Points 
Mid o Droppoilnt 


Aircraft Correct 
Aircraft Slew 
Airerart Pot 
Aircraft Left 


Aircraft Center 
Aircraft Recenter 
Alrerart Pier 


Scale Up 

Scale Increase 
Scale Change 
Scale 64 

Range Up 

Buoy Range 
Sonobuoy Range 
Range Increase 
Range Times Four 
Up Two 
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APPENDIX F 


SUBJECT DATA SHEET 


SUBJECTINO. I AVTYPE 1 
Response number Verbal response Timing (in sec) 
ШЕ Display Position DU? 
2. Ajrcraft Track — 
5. Parnerartesctorreet 6.4 
4. Recenter Aircraft 2-2 
5 Increase Scale 3:0 
Br Ae Lali correct 2:0 
D Display Track 2 6 
5, Display Position 4.6 
9: Increase Scale 216 
RO. Recenter Aircraft 4.0 
Mr. Display Track 220) 
j. Increase Scale 26 
eS Display Position 4.0 
14. Recenter Aircraft 352 
5. pupcraftocorrect 26 
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SUBJECT DATA SHEET 


SUBJECT NO. 2 AVTYPE 1 
Response number Verbal Response Timing (in sec) 
ШЕ; Position S) 
2. Aurerartr Track IES 
S. Displace Aircraft 5.4 
4. Recenter Aircraft IO 
3, Up Scale 20 
6: Displace Aircraft 25:0 
E. Papeerate Track 18 
8. Position 2.4 
J. Up Scale I 
ШО. Recenter Aircraft 20 
I. пита Track O 
2. Up Scale 1.4 
ES. Position TO 
14. Recenter Aircraft 1.4 
5. Displace Aircraft DEG 
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SUBJECT DATA SHEET 


SUBJECT NO. 3 AVTYPE 1 
Response number Verbal Response Taming (ти sec) 
Шо Position 7124 
2. Display Track 3.4 
B. Aena СбггесЕ 4.4 
4. Center Aircraft 4.8 
97. Up Scale 3.4 
б; Auyeratt.correet 30 
E. Display Track 340 
9. Position 4.6 
E Up Scale 2:05 
IV. eenrer, Aircraft 3.0 
EL. Track 2.0 
JM ees Gare 2) 
MS. Position о 
14. Center Aircraft SO 
ES. Correct Aircraft 25 


ТЕ 






SUBJECT DATA SHEET 


SUBJECT NO. 4 AVEZEE | 
Response number Verbal response Timing (in see) 
ШІ Position 7.4 
D Aircraft Track 50 
237 дреса: Correct 220 
4. Center Aircraft 9.4 
D. Up Scale 3.4 
6. ТСга C erst 05,2 
Um Acne Track 3.4 
8. Aarerate Position С 
9, Up Scale 2.4 
IE. Center Aircraft 4.4 
1 Даса Е Track 4.0 
I. Up Scale 2.4 
а. Aircraft Position ІШЕ 2 
14. Center Aircraft eun 
ШЕ; PEC Lau Correct Ола 
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SUBJECT DATA “SHEET 


SUBJECT NO. 5 AVTYPE 1 
Response number Verbal response Timing (in sec) 
1. Display Position Ше б 
E. Alroraft Track 2.4 
E наста Ес Slew 5.4 
4. Aircraft Center 8.4 
S Change Scale WORO 
on Aircraft Slew 4.2 
p. Aircraft Track 2i 
8. Awroratt Position 9. 8 
9. Increase Scale 2.4 
20. Aircraft Center 4.0 
neu. Aircraft Track 5612 
HZ Increase Scale PR 6 
S. Area Bt position 4.2 
14. Aircraft Center 2.4 
Hir. Aircraft Slew 5) 


[5 






SUBJECT DATA SHEET 


SUBJECT NO. 6 AVTYPE 1 
Response number Verbal response Timing (in sec) 
ar Position 4.0 
p Aircraft Track 4.8 
B Arreraft Correct 15446 
4. Center Aircraft 1702 
E. Up Scale 4.0 
5. Mark on Top о 
7 расе паве аск D 
8. Position 6 
EE Up Scale LS 
TO. Center 4.4 
I. Алиша Track 2 40 
EN». Up Scale 2:2 
ES. Position 15 
14. Center 3.2 
15. Mark on Тор 2 
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SUBJECT DATA SHEET 


SUBJECT NO. 7 АУТҮРЕ 1 
Response number Verbal response Timing (in sec) 
a. ASS rate Position 3.4 
2. Aircraft Track 9502 
8: Aircraft Correct 929 
4. Center Aircraft 4.6 
S. Up Scale 3.4 
S. даса Correct 3.4 
p. длета: Track See 
S. Aurceratt Position 30 
I. Bese a> 28 
ПО . Center Aircraft 4.2 
I. Aircraft Track 24 0 
Па, Џр 5саје SN 
NS, Aircraft Position 4.4 
14. Center Aircraft 325 9 
5. Аљона "СоккесЕ 3.4 
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SUBSECT DATA SHEET 


SUBJECTENO. 9 АМТУРЕ 1 
Response number Verbal response Timing (in sec) 
ПЕ. Position o 
2. Display Track 2.0 
B. Arrerart Correet 3.4 
4. Reposition з? 
D. Up Scale 2.4 
6. даска -- Correct SO 
F; Display Track 70 
8. Position 522 
au Up Scale 2.4 
TO. Aircraft Center Sr 
I. Display Track 572 
2. Up Scale 228 
uS. Position 339 
14. Alrcrate Center E 
MS. Arerart Correct 3.4 
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SUBJECT DATA SHEET 


SUBJECT NONE У AUDI 77 
Response number Verbal response Timing- (1n sec) 
ШЕ. Position 4.0 
D Track 4.6 
B Alr raft Correct 122502 
4. Recenter Aircraft БӨ 
B. Increase Scale = 00, 
б. DrrcrartNeorrect 4.8 
Г. Алега ЕЕ Track 52710 
8. Posit 4.2 
B. Increase Scale 26 
10. Aircraft Center 302 
BL. дева Track 22 
T2. Increase Scale 2.6 
B. Posit 3150 
l4. Axrcratt Center 3.0 
T5. Auzerärz Correct 18 
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SUBJECT DATA SHEET 


SUBJECT NO. 10 АУТҮРЕ 1 
Response number Verbal response Timing (in sec) 
j. Aircraft Position Se 
D. Аса Е аск 15 
D. Ae Celera exe 4.6 
4. Recenter Aircraft 4.6 
5% Up Scale 2.4 
6. Aurzerart Cörrect 12% 
n. Aircraft Track 1426 
ei Aircraft Position 2.4 
E Up Scale 1598 
ІК). Aircraft Recenter 3.86 
EL. данска Track 1-40 
112. Ор 5саје 136 
IS. Aircraft Position 256 
14. Aircraft Recenter 208 
aS. Aircraft Correct 3.0 


78 





Response number 


l0. 
IL. 
T2. 
ШЕ. 
та. 


ES. 


УДЕО НИКО. 


SUBJECT DATA SHEET 


11 AVIYBE 1 


Verbal response 


Aircraft 


Alr raft 


Zmeratt 


Recenter 


Increase 


Aurerart 


Zug 


ARAS ue E 


Imerease 


Recenter 


Aircraft 


Increase 


Aero EE 


Recenter 


dE a LE 


79 


Position 


Track 


Gorrect 


Zurerartt 


Scale 


Correct 


Track 


Position 


Scale 


Aircraft 


Track 


Scale 


Position 


Alro rart 


Correct 


Timing 


(in sec) 





SUBJECT DATA SHEET 


SUBJECT NO. 12 AVTYPE 1 
Response number Verbal response Timingi (in Sec) 
ШІ. Display Position 5.4 
2. Aircraft Track SiS 
E Mark on Top EZ 
4. Recenter Aircraft 252 
SR Scale 64 32 
or No Response 20729 
p Aircraft Track 3510 
E Alrcraft Posit p 
о Scale 64 20 
10. Recenter Aircraft 5.0 
EL. Display Track 220 
2. Scales о 3.4 
i3. быу суас PosLit 4.8 
jJ. Recenter Aircraft 22 
NS. Mark on Top Seven 6.4 
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Response number 


ШО. 


l. 


а. 


IS 


14. 


E». 


SUBJECT DAIA SHEET 


SUBJECT NO. 13 АУТҮРЕ 1 


Verbal response 


Position 


Aircraft Traek 


Correct Track 


Center 


Up Scale 


Correct Track 


Alrcraft Track 


Airera t Position 


Up Scale 


Center 


Airera Track 


Up Scale 


Aircraft Position 


Center Aircraft 


Correct Aircraft 


31 


Timing 





(1n sec) 





Response number 


0. 


ESL. 


i. 


NS. 


14. 


15. 





SUBJECT DATA SHEET 


SUBJECT NO. 14 ANA AL 


Verbal response пано оа Бе 
Alreraft Position 6.6 
деса Track DE 
Reposition Aircraft 4.8 
Center Aircraft 12.4 
Increase Scale S. 00 
Reposition Aircraft 4.0 
Arreraft Track 4.6 
Aircraft Position 4.8 
Increase Scale 3m 
Center Aircraft 5 4 
Ваве ас ае 3.0 
Increase Scale Se 
Aircraft position 4.6 
Center Aircraft nao 
Reposition Aircraft 9.8 
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Response number 


ШО. 
IS. 
E. 


13. 


ES. 


SUBJECT DATA SHEET 


Уа 15 AVTYPE 1 
Verbal response jee 
Posit I 
Aircraft Track 4. 
Slew Aircraft 14. 
Aircraft Center s 
Up Scale 4. 
Slew Aircraft E 
Praek Arrerarft D 
niy Orar t Posit S 
Up Scale S 
Aircraft Center б 
Alrcraft Track 55 
Up Scale Eum 
Aircraft Posit 6. 
Aircraft Center Qu 
Update Aircraft dem 
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(in sec) 





Response number 


ШЕ). 
i. 
1 
I. 
14. 


ED, 


SUBJECT NO. 16 





SUBJECT DATA SHEET 


DEEST 


Verbal response 


Position 


Arrerart 


Track 


Slew Aircraft 


uere 


Increase 


ЖЕБЕСІ с 


Arrerart 


Position 


Increase 


Aircraft 


airera t 


Increase 


Position 


донета Бе 


Arrerart 


84 


Cente 


Scale 


Left 


Track 


Scale 


Cente 


Track 


Scale 


Cente 


Left 


E 


r 


16, 


Timing (in sec) 








SUBJECT DATA SHEET 


SIP JUCTUNO I7 AVTYPE 2 
Response number Verbal response Timing (іп сес) 
ir Position S 
2 Ir ci 770 
3% Aurcratt Plot 3.6 
4. Aircraft Plot Шш; б 
5. Scale 4.6 
6. Peeaecratt blot 2.4 
n Track IS 
2: Position Зао 
317 Scale D 
TO. Alrerart. Plot 325 
E. Track 3.4 
ШО. Scale 2.8 
ES. Position 2-22 
14. Aircraft Center 29 
15. Aurcratt PIot 4.0 
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Response number 


20. 


ШІ. 


HA. 


ES. 


14. 


eS 


SUBJECT DATA SHEET 


SUEJECTANO. 18 AVTYPE 2 


Verbal response 


Show Position 
Show Track 

No Response 

No Response 
Display Scale 
Correct Position 
Show Track 

Show Position 


Change Scale 


Center Aircraft 
Show Track 


Show Scale 


Show Position 
Center Aircraft 


Correct Position 
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Timing (in sec) 


dba 





Response number 


20. 


IL. 


2. 


IRS 


84. 


iE. 


SUBJECT DATA SHEET 


DUBSTHCT NO, 19 AVTYPE 2 


Verbal response 


Bearing 

Bearing 
Correction 
Center 

Enlarge 

Correct 

Bearing 

No Response 
Enlarge Scale 
Center 

Frack Aircraft 
Enlarge Scale 
Display Position 
Center Aircraft 


Gorsecbt"' Aircraft 


87 





Timing (in sec) 


10.0 


10.0 





Response number 


ED. 


ЕЕ. 


ШЕ), 


HS. 


ША, 


ES. 


SUBJECT DATA SHE 


SUBJECTENO. 20 


Verbal response 


Position 

REMET Tür 
Reset 

Center 

Scale Up 

Slew Left 

Plot иеп 
Position 

Sc Ten 
Aircraft Center 
Mark Turn 

Scale Increase 
Mark Position 
Aircraft Center 


Slew Left 


88 


ET 


AVTYPE 2 


Timing 


LLSG 
1692 
12.26 
13.8 
1556 
Loud 
14.4 


13.6 


1228 
1520 
pae 
14.0 
15-6 


а 





(in sec) 








SUBJECT DATA SHEET 


SUBE ST NO. 21 AVTYPE 2 
Response number Verbal response Timing (In Sec) 
n. Position 3.4 
2 Trackline 2.4 
B Correct Position 730 
4, Center Pipper EO 
3. Range Up | 2-2 
6: Correct Track 8.8 
Т, Trackline e 
8. Position 4.4 
9 Up Two 10.4 
NO. Center Bug Sac 
НЕ Display Trackline 520 
ШО. Up Two DD 
15. Display Position ВБ 
14. Center Bug s 
i. Correct аек іл пе 4.0 


89 





Response number 


Шо. 


ШІ, 


E. 


ES. 


14. 


15. 





SUBJECT DATA SHEET 


SUBJECT 22 АМТУРЕ 2 
Verbal response Timing (in sec) 
ал понесе 2229 
Ground Track Sp 
Slew Correction 1076 
Shift Display 155509 
Increase Scale 5.9 
Update Aircraft 74720 
Ground Track 20 
Lat аас 4.4 
Increase Scale 4.0 
Center Aircraft 4.6 
Display Track 4.0 
Increase Scale 36 
Lat Long 2 0 
Center Aircraft SS 


| 
со 


@erreet Aircraft 





Response number 


Vo. 


EL. 


2. 


5. 


E. 


E». 





SUBJECT DATA SHEET 


SUBJECT NO. 23 AVTYPE 2 
Verbal response Timing (in sec) 
Posie 8.8 
Track 20 
correct Aircraft 1.02 
Center Aircraft 5.4 
Sonobuoy Range 6.4 
Correct Aircraft 3.4 
Track 2.4 
Posit D 
Buoy Range 5 
Center Aircraft 4.6 
Track 2.0 
Buoy Range 228 
Posit 3.4 
cónter Alrcratt 4.4 
CorrectoAwrcratt 222 


21 





Response number 


wO. 


IE. 


B. 


22 


ША, 


5. 


SUBJECT DATA SHEET 


SUBJECT NO. 24 


Verbal response 


Кок 

Teac History 
Reset 

Cencer 
Increase Scale 
Center 

Display Track 
Position 
Increase Scale 
(Сеш ег 

Desplay Track 
Increase Scale 
Position 
DENS 


ӘЛем, Атусгатс 


22 


AE 2 


DA 





(in sec) 





Response number 


EO. 


EL. 


I2. 


IE. 


l4. 


ES. 


SUBJECT DATA SHEET 


SUBJECT МО. 25 AVTYPE 2 


Verbal response 


Aircraft Position 
Aircraft Track 
Relocate 

Center Display 
Change Scale 
Relocate Aircraft 
Aircraft Track 
Aircraft Position 
Scale 64 

Center Display 
Aircraft Track 
Scale 64 

Aircraft Position 
Aircraft Center 


Slew Aircraft 


23 


J 


pe 


14. 


18: 


a 


P. 


14. 





Timing (in sec) 


f> 





Response number 


BED. 


jur 


BN». 


BS. 


l4. 


No. 


SUBJECT MO. 


Verbal response 


Position 
StaEus 
Change 
Center 
Scale 64 
Change 
SENS 
Position 
Scale 64 
Cencer 
Suec EU S 
Scale 64 
Position 
Center 


Change 


94 


26 


SUBJECT DATA SHEET 


AVTYPE 2 


Timing (in Sec) 





19% 





Response number 


Шо. 
EL. 
1248 
m. 
14. 


Џо. 


SUBJECT DATA SHEET 


SUBJECT NO. 27 AVTYPE 2 
Verbal response Timing 
Position 283 
ae 2.6 
Update Position 3.4 
No Response 20.0 
Scale Change 4.0 
Update Position 4.0 
Doc INS 
Present Position 320 
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